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Statistical  signal  processing  functions  such  as  signal  detection,  estimation,  and  identification  play 
a  key  role  in  the  development  of  effective  communications,  radar,  and  sonar  systems.  For  example, 
advanced  statistical  methods  are  emerging  as  being  particularly  important  in  digital  communications 
systems  operating  in  channels  corrupted  by  interference  from  such  phenomena  as  multiple-access  noise, 
intentional  jamming,  and  impulsive  noise  sources.  Conventional  demodulation  methods,  such  as 
coherent  matched  filtering,  often  suffer  serious  performance  degradation  when  subjected  to  interference 
of  these  types;  however,  this  degradation  can  frequently  be  eliminated  through  the  use  of  more  sophis¬ 
ticated  signal  processing  techniques. 

A  central  issue  in  the  design  of  effective  signal  processing  procedures  for  systems  operating  in 
channels  such  as  those  noted  above  is  that  of  channel  identification.  Although  certain  aspects  of  chan¬ 
nel  identification  have  been  studied  extensively,  one  area  in  which  there  is  a  pressing  n^  for  further 
research  is  that  of  identification  of  impulsive  channels.  Communication  systems  are  seldom  interfered 
with  by  white  Gaussian  noise  alone,  yet  receiving  systems  in  general  use  are  those  which  are  optimum 
for  white  Gaussian  noise.  The  man-made  electromagnetic  environment,  and  much  of  the  natural  one, 
is  basically  "impulsive,"  i.e.,  it  has  a  highly  structured  form  characterized  by  significant  probabilities  of 
large  interference  levels.  In  addition  to  the  man-made  electromagnetic  environment,  Aere  are  many 
other  different,  common  and  widely-used  communications  and  remote-sensing  type  channels  where 
impulsive  noise  dominates,  e.g.,  extra-low-frequency  (ELF)  channels,  urban  radio  networks,  underwater 
acoustic  channels,  and  telephone  line  channels.  This  is  in  contrast  to  the  Gaussian  noise  processes 
inherent  in  transmitting  and  receiving  elements.  Since  the  conventional  receivers  are  effectively  linear, 
the  impulsive  character  of  the  interference  can  drastically  the  performance  of  conventional  systems. 
Furthermore,  since  it  has  been  well-established  that  the  performance  of  communications,  radar,  and 
sonar  systems  can  be  greatly  enhanced  if  the  true  statistics  of  the  channel  ate  known  and  exploited,  fire 
problem  of  identification  of  impulsive  noise  channels  is  important  in  the  develo[Mnent  of  systems  that 
can  approach  the  performance  limits  set  by  such  channels. 

This  research  project  is  concerned  with  the  design  and  develqrment  of  new  rronlinear  algorithms 
for  identification  of  nongaussian  noise  processes  and  for  reception  of  signals  comipted  by  nongaussian 
noise.  In  particular,  the  overall  objectives  of  this  research  project  are:  (i)  the  development  of  suitable 


channel  models  for  impulsive  interference;  (ii)  the  derivation  and  analysis  of  new  globally  optimum 
nonlinear  estimation  procedures  for  the  identification  of  impulsive  interference  channels,  and  (iii)  ^pli¬ 
cation  of  the  developed  algorithms  in  the  design  of  optimum  and  sub-optimum  adaptive  receivers  for 
the  detection  of  signals  in  non-Gaussian  noise  environments. 


RESEARCH  SUMMARY 


During  this  reporting  period,  the  focus  of  our  work  has  been  on  the  problem  of  obtaining 
optimum  and  efficient  identification  and  detection  procedures  for  impulsive  channels.  Of  particular 
interest  is  the  Middleton  Qass  A  noise  model,  which  is  a  widely-accepted  statistical-physical  model  for 
impulsive  interference  superimposed  on  a  Gaussian  background.  The  model  has  two  basic  parameters 
that  can  be  adjusted  to  fit  a  wide  variety  of  impulsive  noise  phenomena  occurring  in  practice. 

We  have  considered  the  problem  of  basic  batch  estimation  of  the  Gass  A  parameters.  In  particu¬ 
lar,  we  have  developed  a  consistent  and  asymptotically  efficient  estimator  of  the  Qass  A  parameters 
that  is  practically  efficient  as  well  [16],[17].  The  development  of  this  estimator  began  with  an 
improved  method-of-moments  estimator  of  the  parameters  based  on  the  extraction  of  two  moments 
chosen  for  their  sensitivity  to  the  channel  parameters.  We  have  shown  that  this  moments  estimator  is 
relatively  simple  to  implement  and  yields  unique  estimates  of  the  parameters  that  converge  to  the  true 
parameters  at  near-optimal  rates.  We  have  also  shown,  via  an  extensive  simulation  study,  that  the  esti¬ 
mator  yields  good  estimates  of  the  parameters  for  moderate  sample  sizes  but  that  a  significant  improve¬ 
ment  in  performance  over  the  method-of-moments  estimator  is  possible  if  an  asymptotically  efficient 
estimator  can  be  found.  The  search  for  such  an  estimator  began  with  a  search  for  a  method  which 
identifies  the  consistent,  and  hence,  asymptotically  efficient  sequence  of  toots  to  the  likelihood  equa¬ 
tion.  One  method  that  has  the  potential  of  providing  such  an  estimator  is  maximum  likelihood.  We 
have  shown  in  this  study  that  the  maximum  likelihood  estimate  (MLE)  is  consistent  for  the  Gass  esti¬ 
mation  problem,  despite  the  existence  of  multiple  roots  in  the  asymptotic  likelihood  equation  [6]. 
However,  the  existence  of  these  multiple  roots  makes  the  MLE  very  difficult  to  implement  For¬ 
tunately,  the  consistent  sequence  of  roots  can  be  located  using  an  alternative  method.  This  method 
consists  of  initiating  Newton’s  root-finding  method  on  the  likelihood  equation  with  the  method-of- 
moments  estimator  and,  in  so  doing,  both  the  consistency  of  the  moments  estimator  and  the  efficiency 
of  likelihood-based  estimation  are  retained.  We  have  shown  that  this  MomentA-ikelihood  procedure 
does  indeed  yield  consistent  and  asymptotically  efficient  estimates  of  the  parameters.  Moreover,  via  an 
extensive  simulation  study,  it  was  seen  that  the  proposed  Moment/Likelihood  procedure  yields  excel¬ 
lent  estimates  of  the  parameters  for  moderate  sample  sizes.  In  addition,  we  have  developed  an  optimi¬ 
zation  scheme  based  on  the  simplex  method  that  can  be  shown  to  converge  to  a  relative  maximum  of 
the  likelihood  function.  An  extensive  simulation  study  of  this  scheme  indicates  that  it  performs  very 
well  for  small  sample  sizes. 

The  problem  of  recursive  estimation  of  the  Gass  A  parameters  was  also  investigated  [7].  Our 
primary  objective  in  this  phase  of  the  study  was  the  development  of  recursive  channel  estimators  that 
are  efficient  for  small  sample  sizes.  Only  in  this  way  can  we  guarantee  that  our  channel  estimator  is 
capable  of  tracking  rapidly-varying  nongaussian  channels.  In  particular,  we  have  developed  a  global 
recursive  estimator  of  the  parameters  that  can  overcome  the  shortcomings  of  conventional  recursive 
stochastic  gradient-type  algorithms  which  make  them  unsuitable  for  impulsive  charmel  identification. 
The  primary  shortcoming  is  that  the  conventional  algorithms  cannot  uniquely  identify  the  Gass  A 
parameters  due  to  the  existence  of  multiple  roots  in  the  asymptotic  likelihood  equation.  This  recursive 
estimator  is  based  on  the  use  of  a  nonstandard  stochastic  approximation  procedure  wherein  the  standard 
Fisher’s  information  matrix,  which  governs  the  step  size  in  the  recursion,  is  replaced  with  a 
"complete-data"  information  matrix.  Two  initiating  estimators  for  this  complete-data  stochastic 


2 


approximation  procedure  were  developed.  The  first  is  a  batch  estimator  which  extracts  estimates  of  the 
parameters  directly  from  a  histogram  of  the  Class  A  envelope  data.  The  second  is  a  method-of- 
moments  estimator  applied  to  a  nontraditional  set  of  observations,  referred  to  as  "complete-data."  At 
each  iteration  of  this  initiating  recursive  estimator,  complete  data  are  generated  from  the  traditional,  or 
incomplete,  observations  using  the  estimate  of  the  parameters  obtained  at  the  previous  iteration.  A 
fixed  parameter  vector  in  the  parameter  space  initiates  the  process.  By  equating  sample  moments  of 
the  complete  data  to  the  true  moments,  estimates  of  the  parameters  are  then  obtained.  Both  initiating 
estimators  were  found  to  yield  estimates  which  lie  in  the  region  of  convergence  of  the  stochastic 
approximation  procedure.  Moreover,  via  an  extensive  simulation  study,  it  was  seen  that  the  proposed 
stochastic-approximation-based  estimators  yielded  global  recursive  procures  through  which  excellent 
estimates  of  the  parameters  were  obtained  for  small  sample  sizes. 

During  this  period,  we  have  also  developed  and  analyzed  the  performance  of  several  non- 
parametric  density  estimators  and  detectors  for  impulsive  noise  channels  [4],[5].  These  nonparametric 
density  estimators  exploit  the  known  properties  of  the  given  noise  environments  and,  in  so  doing,  yield 
estimates  that  closely  approximate  the  true  densities  for  small  sample  sizes.  Two  estimators  have  been 
proposed:  the  first  is  particular  to  envelope  densities,  while  the  second  is  designed  for  symmetric 
instantaneous  amplitude  densities.  The  standard  automatic  kernel  and  variable  kernel  estimators  pro¬ 
vided  the  basis  for  the  construction  of  these  two  estimators.  By  incorporating  the  two-component 
structure  of  the  impulsive  noise  densities  to  be  estimated  into  the  framework  of  these  estimators  and 
choosing  the  variables  of  the  estimators  appropriately,  tremendous  improvements  in  performance  over 
the  basic  kernel  estimators  were  achieved.  In  addition,  a  method  for  evaluating  the  L  i-performance  of 
an  "optimum"  parametric-based  density  estimator  was  derived.  Upon  using  this  method,  it  was  seen 
that  the  performance  of  the  proposed  nonparametric  density  estimators  was  comparable  to  that  of  their 
optimum  counterparts  for  small  values  of  the  sample  size  for  the  wide  variety  of  impulsive  noise  densi¬ 
ties  considered  in  this  study.  These  nonparametric  density  estimators  were  then  used  in  the  develop¬ 
ment  of  various  detection  strategies.  In  particular,  two  likelihood  ratio  tests  were  formulated  using 
these  density  estimators,  one  based  on  the  classical  robust  test,  the  other  on  the  /-I -error-based  deteaor. 
Via  an  extensive  simulation  study,  it  was  seen  that  the  performance  of  these  schemes  was  very  near 
that  of  the  optimum  likelihood  ratio  test  for  small  values  of  the  sample  size.  The  proposed  non¬ 
parametric  density  estimators  were  then  used  in  the  development  of  a  weak-signal  detector  that  approx¬ 
imates  the  locally  optimum  nonlinearity.  By  using  the  basic  features  of  the  robust  and  Lj -error-based 
tests,  a  "precensoring"  method  was  developed  for  this  detector  which  suppresses  the  effects  of  errors  in 
the  density  estimates.  Via  an  extensive  small-sample  size  perfonnance  analysis,  the  performance  of  the 
resulting  detector  was  found  to  be  very  near  that  of  the  optimum  nonlinearity  for  the  wide  class  of 
densities  considered  in  this  study. 
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